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FOREWORD 


The  BESRL  Task,  “Computerized  Models  for  the  Simulation  of  Policies  and  Operations 
of  the  Personnel  Subsystem-SIMPO-I”,  is  conducted  by  the  Statistical  Research  and 
Analysis  Division.  The  Task  constitutes  the  initial  undertaking  of  an  operations  research 
requirement  described  in  the  Army  Master  Study  Program  under  the  title,  “A  Simulation 
Model  of  Personnel  Operations  (SIMPO) "  and  is  Project  2J050222M711 ,  “Army  Operations 
Analysis",  under  the  auspices  of  the  Army  Study  Advisory  Committee.  Subtasks  include: 
a)  Operational  Analysis  of  Personnel  Subsystem;  b)  Cataloguing  and  Integration  of 
Existing  Manpower  Models;  c)  Development  of  Measures  of  System  Effectiveness;  d)  De¬ 
velopment  of  Modeling  Techniques;  e)  Design  and  Programming  of  SIMPO-I;  f)  Application 
and  Evaluation  of  Computerized  Models;  and  g)  Problem  Oriented  Language  for  Manage¬ 
ment. 


The  effort  is  closely  allied  to  the  SRAO  Task,  “Optimization  Models  for  Manpower 
Operations  Research",  under  Army  Project  2J024701A732,  FY  1968  Work  Program.  The 
advantage  of  pursuing  the  optimization  and  simulation  research  in  juxtaposition  is  that 
system  simulation  provides  the  most  efficient  and  economical  means  of  determining 
amount  of  gain  and  costs  of  implementing  given  policy  alternatives. 


The  present  publication  reports  on  the  development  of  the  entity  simulation  model 
designed  for  inclusion  in  the  SIMPO-I  library  of  computer  programs. 


J.  E.  UHLANER.  Director 
U.  S.  Army  Behavioral  Science 
Research  Laboratory 
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SIMPO-I  ENTITY  MODEL  FOR  DETERMINING  THE  QUALITATIVE 
IMPACT  OF  PERSONNEL  POLICIES 


BRIEF 


Requirement: 

To  simulate  military  personnel  subsystems  in  order  to  predict  and  assess  the  total 
result  of  policy  changes  and  to  develop  computer-aided  research  methods  and  tools  that 
increase  the  Army's  in-house  capability  for  responding  to  personnel  management  research 
requirements. 


Research  Product: 

The  generalized  entity  simulation  model  which  has  been  installed  and  tested  on  the 
computer  system  in  BESRL's  Statistical  Research  and  Analysis  Division  serves  to  model 
characteristics  common  to  a  general  class  of  personnel  functions.  An  entity  simulation 
is  one  in  which  individuals  are  explicitly  represented  as  opposed  to  a  mass  flow  model 
in  which  only  characteristics  of  groups  of  individuals  are  specified.  The  basic  population 
from  which  simulated  individuals  are  randomly  sampled  is  the  multivariate  normal,  al¬ 
though  the  non-random  sampling  which  often  results  in  non-normal  distributions  may  also 
be  simulated.  Option  of  optimizing  performance  of  a  sample  over  multiple  job  categories 
is  built  into  the  model,  and  criterion  measures  can  be  related  to  results  of  optimal  alloca¬ 
tion.  Processing  of  manpower  information  may  be  simulated  by  use  of  linear  transforma¬ 
tions.  The  computer  program  is  written  so  that  modifications  can  easily  be  made  to  in¬ 
corporate  special  features  in  the  model. 


Utilization  of  the  Research  Product: 

The  intention  is  to  incorporate  the  initial  generalized  model  in  the  SIMPO-I  computer 
program  library.  It  is  intended  that  this  model,  after  further  modification,  will  become  a 
module  in  the  SIMPO-I  simulation  package  for  evaluation  of  personnel  and  manpower 
policy  alternatives  across  the  Army's  major  personnel  functions.  The  entity  model  con¬ 
centrates  on  the  procurement,  selection,  and  allocation  aspects  of  the  personnel  system. 
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SIMPO-I  ENTITY  MODEL  FOR  DETERMINING  THE  QUALITATIVE 
IMPACT  OF  PERSONNEL  POLICIES 


BACKGROUND  AND  FUNCTION 

A  generalized  entity  simulation  model  has  been  successfully  in¬ 
stalled  and  tested  on  the  computer  system  of  the  U.  S.  Army  Behavioral 
Science  Research  laboratory*  This  model  ie  described  in  the  context  of 
the  management  research  requirements  for  which  it  was  designed  and  of 
the  research  design  considerations  which  influenced  its  development. 

It  is  designed  for  Inclusion  In  the  computer  program  library  of 
SIMPO-I. 

SIMPO-I,  when  completed,  will  consist  of  a  relatively  comprehensive 
computerized  model  of  the  Arny  personnel  subsystem— in  effect,  a  Simula - 
tion  package  and  a  library  of  computer  programs.  The  simulation  package 
will  be  capable  of  reflecting  the  trade-offs  across  major  personnel  func¬ 
tions  that  would  result  from  the  implementation  of  specific  sets  of  per¬ 
sonnel  and  manpower  policies.  The  SIMPO-I  library  will  contain  computer 
programs  implementing  highly  specialized  simulation  models  as  well  as 
programs  intended  as  computational  devices  for  obtaining  parameter  values 
for  entering  into  the  simulation  models. 

The  simulation  model  reported  here  was  designed  to  function  as  a 
stand-alone  program  for  inclusion  in  the  SIMPO-I  library.  However,  the 
entity  model  will  also  be  modified  to  constitute  the  procurement,  selec¬ 
tion,  and  allocation  module  of  a  mare  comprehensive  model  developed  under 
the  SIMPO-I  research  effort.  Other  modules  will  depict  such  personnel 
functions  as  distribution,  tour  rotation,  promotion,  and  training  and 
will  have  appropriate  interfaces  with  the  entity  model  reported  here. 

The  entity  model  ie  not  Intended  to  be  the  primary  means  of  simulating 
these  latter  functions,  although  the  model  can  portray  these  functions 
efficiently  for  a  variety  of  policies. 

Personnel  System  Problems 

Answers  to  many  questions  that  arise  in  the  course  of  military  man¬ 
power  planning  await  the  development  of  more  effective  investigative 
methods.  Too  often  Objective  investigation  of  important  questions  has 
not  been  feasible  with  the  tools  available  to  personnel  and  manpower 
management  officers.  Experimental  studies  involving  the  real  manpower 
system  are  expensive  both  in  cost  of  data  collection  and  in  reduced 
efficiency  of  the  manpower  system,  in  particular  when  the  policy  being 
tested  operationally  ie  found  to  be  grossly  Inadequate.  Evaluation  of 
alternative  procedures  can  be  relatively  Inexpensive,  however,  if  the 
personnel  system  can  be  modeled  and  the  experimental  results  can  be 
based  on  e  computerized  simulation  of  the  system.  Relationships  between 
requirements,  assignment  procedures,  input  from  outside  the  system  (for 


example,  from  external  procurement  or  from  training  facilities),  quantity 
and  quality  of  personnel  information  made  available  to  the  system,  attri¬ 
tion  of  the  system,  and  measures  of  system  effectiveness  have  been  suc¬ 
cessfully  studied  through  computer  simulations. 

Problems  related  to  assignment  of  personnel  to  Jobs  or  Job  cate¬ 
gories  form  a  major  subgroup  of  problems  which  can  be  profitably  studied 
through  simulation  models.  The  interests  of  manpower  management  offices 
often  center  on  the  comparison  of  alternative  policies  for  assigning 
enlisted  men  to  meet  prescribed  minimum  qualification  standards.  Policy 
may  specify  as  objectives  the  sequential  minimization  of  transportation 
costs,  an  increase  in  the  number  assigned  to  their  preferred  occupational 
area,  and  optimization  of  expected  performance  on  the  job  (as  predicted 
from  scares  on  paper -end -pencil  tests  or  from  other  information  recorded 
in  the  personnel  folder).  Different  policies  may  change  the  order  in 
which  pertinent  variables  ore  optimized  or  may  create  a  need  for  varying 
degrees  of  partial  optimization  at  each  stage.  Related  problem  areas 
which  may  be  examined  by  naans  of  a  simulation  model  may  involve  1)  de¬ 
signing  testing  programs  for  personnel  assignment,  2)  formulating 
policies  which  change  standards  far  enlistment  and  induction,  and.  3) 
estimating  the  impact  of  increased  mobilization  on  the  quality  of 
assigned  men.  Analytic  approaches  which  would  handle  problems  of  this 
level  of  complexity  have  been  proposed  (l)  but  have  not  proved  economical. 
Results  which  could  serve  as  actual  solutions  to  these  problems  have  been 
heavily  based  on  simulation  techniques  • 

The  simulation  approach  la  particularly  necessary  when  some  use  is 
made  of  optimization  techniques  within  the  system  to  be  evaluated.  Ex¬ 
pected  output  for  a  modeled  system  is  often  examined,  for  example,  after 
simulated  individuals  in  a  sample  have  each  been  assigned  to  a  Job  in 
such  a  way  as  to  maximize  the  average  expected  performance  far  the  sample* 
The  assignments  may  he  based  in  part  an  linear  programing  algorithms. 

The  beneficial  application  of  such  optimization  methods  has  been  demon¬ 
strated  even  when  the  metrics  which  characterize  a  personnel  system  are 
not  of  the  interval  type  assumed  in  the  derivation  of  the  techniques 
involved  (2). 

Certain  problems  require  special  attention  in  designing  and  using 
system  models  for  simulation  experiments ,  notably  the  choice  of  suitable 
research  design  and  of  appropriate  criterion  variables.  Also  of  interest 
is  the  a ore  general  issue— the  type  of  model  to  be  developed.  First,  the 
experimenter  must  ascertain  whether  a  deterministic  model  is  adequate  far 
his  purpose.  With  a  deterministic  model,  one  evaluation  yields  the  re¬ 
sults  of  interest,  since  the  output  is  exactly  determined  by  input,  with 
no  random  variations  to  affect  results.  In  sene  systems,  however,  there 
are  variables  that  cannot  be  fully  controlled  by  either  laboratory  or 
statistical  techniques.  The  effect  of  variation  in  these  variables  re¬ 
sembles  that  of  random  fluctuations.  Also,  the  magnitude  and  the  dis¬ 
tribution  characteristics  of  the  variations  may  relate  to  a  relatively 
complex  function  of  variables  that  fluctuate  randomly.  Hence,  stochastic 


models  are  used  in  which  the  randomness  of  the  system  is  represented,  by 
random  variables  with  specified  probability  distributions.  The  latter 
approach  is  thought  to  be  generally  more  appropriate  for  simulations 
involving  the  personnel  system. 

The  random  variation  characteristic  of  the  real  system  can  be  easily 
simulated  if  the  population  of  interest  can  be  represented  by  a  known 
statistical  distribution.  Samples  are  constructed  by  generating  random 
numbers  and  then  transforming  these  numbers  to  yield  observations  which 
can  be  expected  to  have  the  statistical  properties  of  the  population 
scores.  This  "model  sampling"  is  performed  repeatedly  to  insure  against 
basing  conclusions  on  a  non-typical  although  random  sample  of  simulated 
entitles.  Similarly,  replications  permit  an  evaluation  of  the  critical¬ 
ity  of  the  chance  input  into  the  system  and  provide  a  forecast  of  output 
fluctuations  which  can  be  expected  under  operational  conditions. 

The  stochastic  approach  often  becomes  necessary  when  a  practical 
solution  to  some  particularly  complex  problem  must  be  found,  for  example, 
to  ascertain  the  consequences  of  applying  a  set  of  rules  to  select, 
assign,  train,  and  distribute  individuals.  Suppose,  however,  the  dis¬ 
tribution  of  personnel  according  to  policies  involving  min-inw  qualifi¬ 
cations,  quotas,  and  optimal  assignment  rules  can  be  described  as  a 
fairly  complicated  set  of  mathematical  functions.  This,  Indeed,  mey  be 
possible.  To  make  the  model  workable,  however,  multiple  integrals, 
possibly  with  variable  limits,  would  have  to  be  evaluated.  Many  such 
integrals— involving  most  multivariate  distributions  of  interest— are 
Impossible  to  evaluate  analytically,  and  a  numerical  analyst  would 
probably  resort  to  a  "Monte-Carlo"  solution,  making  use  of  "clever" 
variance  reduction  techniques.  Such  an  approach,  however,  would  be  a 
very  specialized  type  of  model  sampling. 

Furthermore,  when  the  flow  or  any  other  manipulation  of  individuals 
according  to  prescribed  policies  must  be  simulated,  either  real  records 
must  be  sampled  or  artificial  persons  oust  be  generated.  Real  records 
cannot  be  sampled  when  hypothetical  policies  that  have  never  been  imple¬ 
mented  are  under  study.  Nor  is  it  possible  to  simulate  meaningfully  a 
sample  which  exactly  characterizes  the  population  of  Interest.  Instead, 
the  solution  is  to  generate  observations  which  have  the  same  statistical 
properties  in  all  essential  respects  as  if  they  had  been  drawn  as  random 
samples  from  the  prescribed  population.  Again,  this  process  is  a 
stochastic  one. 


RESEARCH  DESIGN  CONCEPTS 

Many  of  the  applications  appropriate  for  the  SIMPO-I  simulation 
model  described  in  the  present  Research  Note  would  use  an  optimal 
assignment  model  as  a  means  of  describing  the  idealized  assignment 
system.  Seme  studies  deal  with  policies  for  assigning  personnel  so  as 
to  maximize  average  predicted  school  or  on-the-job  performance.  In 


other  studies,  a  set  of  policies  that  utilize  optimal  assignment  proce¬ 
dures  at  seme  point  In  the  system  may  be  Included  only  as  a  standard 
against  vhich  to  compare  other  policies.  In  any  case,  a  simulation  of 
the  input  and  distribution  of  enlisted  men  through  Individual  careers 
should  utilize  the  wealth  of  data  that  relates  performance  In  many 
different  Jobs  to  a  vide  range  of  predictor  variables.  Numerous  studies 
have  established  the  adequacy  of  linear  equations  In  predicting  such 
performance. 

When  it  is  desired  to  maximize  accuracy  of  estimates  of  performance 
in  a  Job,  coefficients  of  the  optimum  linear  function  of  a  set  of  pre¬ 
dictor  variables  are  obtained  according  to  least-squares  regression 
techniques.  The  question  might  be  raised  whether  these  least-squares 
predictions  will  also  be  the  appropriate  parameter  values  when  it  is 
desired  to  allocate  men  to  Jobs  in  such  a  way  as  to  maximize  the  average 
predicted  performance  of  all  men  in  the  sample.  Brogden  (3)  has  demon¬ 
strated  that  there  is  no  better  set  of  linear  functions  of  the  predictor 
variables  than  these  least-square  equations  far  accomplishing  this  pur¬ 
pose.  That  is,  a  predetermined  set  of  tests  yields  maximum  allocation 
effectiveness  when  the  predictor  variables  are  given  the  least-squares 
regression  weights  as  computed  separately  against  each  performance  cri¬ 
terion.  Thus,  use  of  these  full  regression  equations  to  compute  pre¬ 
dicted  performance  scores  for  each  Job  and  the  use  of  these  scores  in  an 
optimized  assignment  model  will  assure  that  the  expected  average  perform¬ 
ance  of  the  assigned  men  has  been  maximized.  On  the  other  hand,  while 
no  other  set  of  weights  could  make  this  particular  set  of  predictor  vari¬ 
ables  more  effective,  a  particular  variable  may  be  contributing  so  little 
that  its  removal  would  have  little  effect. 

Basic  to  the  design  of  a  simulation  experiment  is  the  generation  far 
every  individual  of  a  vector  of  k  independent  random  numbers ;  thus,  any 
vector  is  an  individual  response  basis  in  k  dimensions.  The  numerical 
operations  or  functions  which  characterize  different  personnel  policies 
are  then  applied  to  each  of  the  vectors.  Consequently,  experiments  de¬ 
signed  to  investigate  system  output  under  different  policies  can  be  based 
on  the  same  entities  or  simulated  individuals  (l.e. ,  the  same  vectors) 
for  each  of  the  policies.  In  other  words,  an  identical  sequence  of 
random  nusbers  can  be  generated  for  every  policy  so  that  the  functions 
vhich  define  variations  in  assignment,  enlistment,  or  retirement,  say, 
are  applied  to  numerical  values  whose  stochastic  components  are  identical. 

Cue  consequence  of  this  way  of  proceeding  is  that  sampling  vari¬ 
ability,  which  is  a  function  of  differences  between  the  response  bases 
of  random  nuntoers,  occurs  from  person  to  person  but  not  from  policy  to 
policy.  Additional  sources  of  random  variation,  of  course,  might  be 
built  into  the  functions  vhich  simulate  policies.  Even  so,  a  relatively 
high  component  of  response  differences  compared  to  stochastic  sources  of 
variation  will  be  directly  attributable  to  the  effect  of  policy. 


Difficulties  occur  with  respect  to  statistical  design,  however, 
when  observations  corresponding  to  different  policies  are  based  on  the 
sane  sample  of  subjects.  To  test  the  hypothesis  that  overall  job  per¬ 
formance  is  significantly  greater  under  policy  j  than  under  policy  k, 
an  analysis  of  variance  would  require  that  estimates  of  error  variation 
be  independent  for  each  policy,  not  correlated  as  when  computed  from  the 
same  set  of  subjects.  A  t-test  for  correlated  means  is  appropriate  when 
there  are  only  two  policies,  but  it  becomes  inappropriate  when  there  are 
multiple  policies  or  when  a  more  complex  factoring  of  experimental  con¬ 
ditions  is  of  interest. 

Often,  a  multivariate  analysis  of  variance  is  particularly  suitable 
when  repeated  measurements  are  made  on  the  same  entities.  Tests  concern¬ 
ing  group  differences  take  into  account  covariation  as  well  as  variation 
between  the  dependent  variates,  and  may  lead  to  conclusions  quite  differ¬ 
ent  from  those  which  would  have  resulted  if  a  series  of  univariate  anal¬ 
yses  had  been  performed.  In  the  case  of  comparing  policies  based  on  the 
same  Individuals,  however,  the  dependency  between  observations  occurs 
across  treatments,  so  that  the  estimates  of  error  variation  are  not  in¬ 
dependent,  as  is  required  for  both  multivariate  and  univariate  analyses 
of  variance. 

Wilks  (4)  has  developed  statistical  criteria  for  testing  equality 
of  means,  equality  of  variances,  and  equality  of  covariances  for  a  multi¬ 
variate  normal  population  of  k  variables  on  the  basis  of  a  sample.  The 
test  for  equality  of  means  would  seem  appropriate  when  applied  to  k 
measures  of  system  effectiveness  which  correspond  to  different  allocation 
policies,  but  which  represent  the  same  individual.  To  make  this  test  of 
no  significant  mean  differences,  however,  equal  variances  and  covariances 
for  the  k  measures  across  different  policies  must  be  assumed.  This  con¬ 
dition  would  not  be  restrictive  if  interest  were  in  establishing  that  the 
output  measures  of  system  effectiveness  are  parallel  measures,  a  situa¬ 
tion  for  which  the  Wilks  criteria  are  well  suited.  Rarely,  however,  would 
equality  of  either  variances  or  covariances  be  expected  when  observations 
are  obtained  from  the  complex  series  of  operations  which  simulate  person¬ 
nel  assignment  procedures.  In  such  case,  equality  could  occur  only  if 
the  same  functions  were  applied  to  the  random  number  vectors  to  simulate 
different  policies. 

A  more  subtle  difficulty  may  complicate  the  choice  of  appropriate 
statistical  tests  for  simulated  observations.  When  all  observations  are 
independently  sampled  for  an  analysis  of  variance,  it  is  the  random  fluc¬ 
tuation  from  treatment  to  treatment,  as  well  as  from  individual  to  indi¬ 
vidual,  which  permits,  under  the  null  hypothesis,  the  determination  of 
the  two  Independent  estimates  of  error  variance  necessary  for  testing 
the  significance  of  treatment  differences.  When  multiple  observations 
are  obtained  from  the  same  individual  in  the  field  situation,  uncorre¬ 
lated  measurement  error  still  occurs  from  treatment  to  treatment,  even 
though  estimates  of  it  may  not  be  directly  obtainable.  The  choice  of 
specialized  statistics!  criteria  such  as  the  Wilks  criteria  when  con¬ 
sidering  parallel  tests  may  permit  significance  teats  of  treatment 
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differences.  When,  however,  there  is  no  error  across  treatments,  as  when 
observations  simulating  policy  differences  are  generated  from  the  same 
random  nusfeers,  statistical  testing  of  treatment  differences  may  require 
experimental  designs  different  from  those  developed  to  provide  Inferences 
regarding  empirical  data.  It  may  frequently  be  possible  to  take  advantage 
of  the  fact  that  the  experimenter  using  a  simulation  model  knows  many  of 
the  universe  values  of  variables  for  which  he  could  only  make  Inferences 
If  he  were  using  empirical  instead  of  computer  generated  data. 

If  research  designs  appropriate  far  empirical  data  are  to  be  used, 
direct  comparability  of  different  policies  within  individuals  may  be 
sacrificed  and  simulation  limited  to  observations  which  are  Independent 
over  treatments.  The  extensive  range  of  statistical  designs  associated 
with  both  multivariate  and  univariate  analyses  of  variance  could  then  be 
legitimately  used  in  personnel  system  investigations  using  generated 
data.  (face  statistical  significance  of  treatment  differences  Is  estab¬ 
lished,  the  policy  differences  can  be  estimated  by  repeating  the  simula¬ 
tion,  but  with  entities  generated  from  the  3ame  sequence  rather  than  from 
Independent  sequences  of  random  numbers.  Direct  comparison  In  which  the 
individual  serves  as  his  own  control  of  treatment  effects  Is  frequently 
not  possible  using  actual  observations.  Such  comparison  may  be  con¬ 
sidered  a  refinement  characteristic  of  simulation  experiments. 


CRITERION  CONCEPTS  L 

In  describing  computerized  models ,  variables  of  three  types  mey  be 
considered.  The  first  define  the  system.  Values  assigned  to  these  vari¬ 
ables  are  the  "givens,"  tbs  requirements  or  restraints  contained  within 
the  system.  The  second  are  variables  related  to  tbs  policy  or  procedure 
being  evaluated;  these  are  modified  to  simulate  different  experimental 
effects.  An  optimal  assignment  process  can  be  either  type  of  variable; 
that  is,  optimization  may  be  incorporated  into  the  main  framework  of  the 
system  or  It  may  represent  one  of  alternate  effects  under  study.  The 
third  type  of  variable  is  the  criterion  variable.  It  provides  means  of 
establishing  the  validity  of  the  model,  as  well  as  of  evaluating  policy 
or  procedural  alternatives  simulated  within  the  model.  Great  care  must 
he  taken  in  defining  the  criterion  index  for  the  model  not  only  to  assure 
high  degree  of  isometry  with  a  criterion  in  the  real  system,  but  also  to 
establish  that  the  model  criterion  la  related  to  the  particular  system 
criterion  accepted  by  or  at  least  acceptable  to  management.  Often  there 


^  A  separate  S2MP0-I  subtask  ie  devoted  to  problems  of  criteria 
(SIMPO-I  c:  Development  of  Measures  of  System  Effectiveness). 
Only  preliminary  considerations  as  they  relate  to  entity-type 
models  are  given  In  this  section. 


are  several  possible  criteria;  therefore,  consideration  oust  be  given  to 
the  possibility  and  advisability  of  defining  sane  overall  criterion  of 
system  effectiveness  which  would  be  a  function  of  two  or  mare  of  the 
possible  criteria. 

Any  discrepancy  between  the  model  criterion  Index  and  the  criterion 
variable  in  the  real  system  may  be  cause  to  modify  both  the  criterion 
index  and  the  model.  There  Is,  of  course,  an  alternative  point  of  view. 
The  model  may  be  Intended  as  a  simulation  of  an  Ideal  system.  When  this 
Is  the  case,  discrepancies  between  the  model  Index  and  the  system  Index 
merely  indicate  that  the  real  system  diverges  from  the  ideal.  The  manner 
In  which  this  divergence  occurs  should  be  understood  in  Interpreting 
simulated  results. 

Modeling  becomes  more  complex  when  there  are  several  variables 
against  which  system  effectiveness  oust  be  evaluated.  Sven  when  a  model 
for  personnel  assignment  Is  designed  for  very  specific  military  applica¬ 
tions,  more  than  one  of  the  following  may  need  to  be  considered  as  cri¬ 
terion  variables :  reenlistment  rate ,  selection  ratio  for  promotion, 
quality  of  fighting  foree,  shortages  of  particular  types  of  personnel, 
and  reduction  In  attrition  of  potential  leaders. 

Oert&in  criterion  variables,  which  may  be  called  "restrictive 
criteria, "  are  used  only  to  identify  characteristics  which  are  prohibited 
in  tbs  system.  Amy  policy  which  exhibits  these  undesirable  character¬ 
istics  Is  considered  to  lie  outside  the  class  of  feasible  policies. 
Multiple  criteria  such  ae  these  present  no  difficulty,  since  policies 
may  be  examined  with  regard  to  any  number  of  restrictions.  Other  cri¬ 
teria,  which  may  be  categorized  as  "maximization  criteria,"  are  used  to 
Identify  optimal  policies.  When  there  are  multiple  criteria  of  this 
type,  the  evaluation  of  system  output  may  be  particularly  difficult. 

One  approach  Is  to  Investigate  the  tradeoffs  among  the  criteria.  Dis¬ 
proportionate  increases  In  one  criterion  value  may  be  found  to  accompany 
small  decreases  In  another.  Another  approach  is  that  of  nesting  optimi¬ 
zations.  First,  a  hierarchy  of  criterion  variables  is  established. 
Optimization  of  the  system  then  proceeds  variable  by  variable,  starting 
at  the  highest  priority.  With  each  optimization,  the  feasible  solution 
space  is  reduced,  until  a  point  is  reached  in  which  further  optimization 
of  the  system  cannot  be  accomplished.  Results  obtalnsd  for  the  higher 
priority  optimization  procedures  are  not  affected  by  the  successive  solu¬ 
tions,  however,  and  evaluation  of  the  system  can  be  based  on  the  space 
of  feasible  solutions  or  on  a  function  of  the  set  of  values  obtained 
separately  (and  sequentially)  for  each  of  the  Objective  functions. 


GENERALIZED  MODEL  COMPUTER  PROGRAM 

The  Statistical  Research  and  Analysis  Division,  BESRL,  has  developed 
a  computer  program  whioh  serves  to  model  characteristics  cccmon  to  a 
general  class  of  personnel  functions.  The  model  is  stochastic,  and  the 
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basic  populations  freer  which  Simla  ted  Individuals  are  randomly  sampled 
is  the  multivariate  normal,  although  non-random  sampling  resulting  in 
non-normal  distributions  may  also  be  simlated.  The  option  of  optimizing 
performance  of  a  sample  over  multiple  Job  categories  is  built  into  the 
model,  and  criterion  indices  can  be  related  to  the  re  suite  of  optimal 
allocation*  Processing  of  manpower  information  may  be  simlated  by  use 
of  linear  transformations.  To  expand  the  model  to  contain  more  specific 
features,  the  computer  program  is  written  so  that  modifications  can  be 
easily  incorporated. 

Operations  of  the  program  are  outlined  in  the  flow  diagram  shown  in 
Figures  1  and  2.  Input  of  transformation  matrices  and  parameters  which 
determine  characteristics  of  the  system  are  represented  in  box  1.  Defined 
are  the  number  of  samples  to  be  simulated,  the  nuntocr  of  individuals  in 
each  sample,  parameters  which  determine  transformations  to  be  performed 
on  individual  score  vectors  before  and  after  allocation.  Job  categories 
and  quotas,  and  a  starting  vector  for  random  mmfcer  generation.  Addi¬ 
tional  input  may  be  read  by  subroutines  written  to  expand  the  model 
(box  2). 

Output  consists  of  summary  statistics  computed  over  all  individuals 
constituting  a  given  sample  (box  4)  and  also  of  tha  multiple  replications 
which  are  customarily  performed  for  a  given  experiment  (box  5)« 

Tbs  simulation  model  (box  3)  1*  shown  in  more  detail  in  Figure  2. 

Tbs  "general"  part  of  the  simulation  model  begins  with  the  automatic 
generation  of  a  vector  of  random  normal  deviates  to  represent  each  entity 
or  individual  (box  6  of  the  flow  diagram);  an  this  vector  are  performed 
a  series  of  linear  transformations  of  the  farm  v  -  u  K  +  m  (box  7). 

K  may  be  a  matrix  of  least-square  regression  coefficients"~far  obtaining 
performance  estimates  v  from  a  set  of  predictor  scores  u;  m  art  the 
additive  constants  to  yield  estimates  with  specified  means.  A  special 
purpose  for  which  K  is  used  in  simulation  studies  is  to  transform  random 
normal  deviates,  which  have  an  expected  covariance  matrix  equal  to  the 
identity  matrix,  into  variates  with  an  expected  covari&noe  matrix  char¬ 
acteristic  of  the  population  under  investigation.  As  indicated  in 
Figure  2,  the  user  specifies  the  series  of  linear  transformations  re¬ 
quired  to  generate  a  particular  sample  by  Inputting  the  covariance 
matrices  and  vectors  of  mean  values  and  then  referencing  these  matrices 
on  special  transformation  cards,  which  are  input  in  the  order  of  the 
transformations  to  be  performed.  The  p  cards  define  LOOP  T  for  computa¬ 
tions  to  be  performed  before  allocation,  and  the  q  cards  which  follow 
define  LOOP  T  for  computations  after  allocation. 

To  perform  non-linear  transformations  on  the  score  vectors  generated 
far  each  individual,  or  to  perform  any  other  operation  to  simulate  char¬ 
acteristics  of  a  more  specialized  system,  specially  written  subroutines 
can  be  incorporated  into  operations  under  control  of  the  main  program. 
Modification  and  recompilation  are  required  only  for  a  short  subprogram, 


not  for  tbs  main  program.  The  subroutines  are  assigned  Integer  names 
and  are  called  by  listing  these  Integers  In  the  order  the  subroutines 
are  to  be  performed  on  the  very  cards  which  define  the  sequence  of 
linear  transformations  (i.e. ,  parameters  within  LOOP  T). 

The  parameter  subroutines  are  also  used  to  determine  whether  the 
scores  being  generated  for  a  given  individual  are  consistent  with  sample 
characteristics  defined  for  a  particular  investigation.  As  the  opera¬ 
tions  specified  on  each  transformation  card  are  completed,  an  index, 
which  may  have  been  set  to  reject  a  given  individual  by  any  of  the  sub¬ 
routines,  is  automatically  sensed  by  the  main  program  (box  9  of  the  flow 
diagram).  Thus,  tests  for  individual  acceptance  or  rejection  may  be 
performed  repeatedly  and  at  any  stage  in  the  computations. 

The  result  of  the  sequence  of  operations  specified  on  the  transfor¬ 
mation  cards  is  the  construction  of  an  N  x  c  matrix  of  performance  mea¬ 
sures;  the  c  columns  correspond  to  Job  categories  under  investigation, 
and  the  N  rows  represent  the  individuals  in  the  sample.  Based  on  this 
matrix,  each  of  the  N  individuals  is  optimally  assigned  to  one  of  the  c 
Jobs  in  such  a  way  that  required  quotas  for  the  different  jobs  are  met 
(box  12). 

After  assignment,  the  response  vectors  for  the  N  individuals  are 
regenerated  to  compute  statistics  that  are  functions  of  the  job  to  which 
each  individual  is  assigned  (box  13).  These  are  the  computations  speci¬ 
fied  on  the  second  set  of  transformation  cards  previously  input  and 
serving  to  redefine  LOOP  T.  Additional  parameter  subroutines  are  in¬ 
cluded  if  special  computations  are  required.  (Allocation  averages  and 
frequency  distributions  for  jobs  to  which  men  are  assigned  are  examples 
of  statistics  used  in  summarizing  kinds  of  simulation,  and  general 
routines  have  been  prepared  for  computation  of  these  statistics . )  In 
order  for  simulated  performance  measures  to  represent  the  same  indi¬ 
viduals  both  before  and  after  optimal  allocation,  the  starting  vector 
of  random  numbers  is  re -initialized  after  allocation. 


REPRESENTATIVE  APPLICATIONS 

The  purpose  here  is  to  describe  typical  problems  for  which  this 
simulation  model  is  well  suited.  Among  the  series  of  experiments  which 
motivated  development  of  a  general  program  was  a  study  by  Sorenson  (5) 
on  the  use  of  full  regression  equations  versus  aptitude  area  scores  for 
the  optimal  allocation  of  enlisted  men.  The  eleven  tests  of  the  Army 
Classification  Battery  are  designed  to  predict  performance  in  different 
Job  areas.  However,  the  operating  Army  personnel  system  is  basing  pre¬ 
dictions  on  computationally  simplified  composites  of  only  two  tests. 

The  purpose  of  the  simulation  was  to  estimate  the  performance  gain  using 
the  full  set  of  measures  compared  with  the  abbreviated  set. 


Figure  1.  Flow  diagram  for  general  computer  model 


Figure  2.  Simulation  of  personnel  policies  and  procedures 
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Performance  estimates  obtained  by  each  of  the  two  methods  were  used 
to  allocate  optimally  samples  of  men  into  eight  Job  areas  such  that  pre¬ 
scribed  quotas  were  met*  The  difference  between  the  performance  averages 
over  simulated  samples  after  optimal  allocation  provided  a  measure  of 
differential  effectiveness  of  the  two  methods  of  combining  predictors. 

The. gain  over  random  allocation  vas  roughly  doubled  by  the  use  of  re¬ 
gression  equations. 

Results  for  the  published  study  were  obtained  from  a  specially 
written  program,  but  re -analysis  could  now  be  performed  much  more  simply 
because  of  the  availability  of  the  general  program.  The  two  kinds  of 
performance  estimate  would  be  constructed  automatically  and  simply  within 
the  program  by  performing  an  appropriate  sequence  of  linear  transforma¬ 
tions  on  the  vector  of  random  numbers  generated  to  represent  each  indi¬ 
vidual.  The  user  would  need  only  to  input  the  necessary  transformation  - 
matrices  as  data  and  to  specify  on  parameter  cards  the  order  in  which 
they  are  to  be  used. 

As  example  of  the  type  of  simulation  which  would  require  the  use  of 
specially  written  parameter  subroutines  as  well  as  the  automatic  features 
of  the  general  program  was  reported  by  Sorenson  at  the  1966  Army  Opera¬ 
tions  Research  Symposium.  A  specially  written  program  which  did  not  have 
the  more  general  properties  of  the  entity  model  was  used  to  obtain  these 
results.  The  purpose  of  the  simulation  was  to  examine  the  effect  of 
metric  changes  on  the  results  of  optimal  allocation.  In  using  the  general 
program,  performance  estimates  for  each  individual  on  different  Job  cate¬ 
gories  would  be  constructed  by  linear  operations  similar  to  those  used 
for  the  study  Just  described.  Each  set  of  observations  would  then  be 
modified  to  represent  eight  different  metrics.  For  example,  criterion 
estimates  with  an  expected  mean  of  100  and  standard  deviation  of  20  would 
be  converted  to  two-digit  integer  scores  ranging  from  0  to  99  by  sub¬ 
tracting  50  and  truncating.  One-digit  scores  from  0  to  9  would  be  formed 
by  subtracting  50,  dividing  by  10,  and  truncating.  Ordinal  scales  would 
be  constructed  by  ranking  individuals  within  Jobs.  These  modifications 
would  be  performed  by  specially  prepared  parameter  subroutines.  After 
control  vas  returned  to  the  main  program,  an  optimal  allocation  proce¬ 
dure  would  be  performed  for  each  type  of  metric,  along  with  the  computa¬ 
tion  of  measures  of  overall  performance  from  which  the  effect  of  the 
various  metrics  could  be  evaluated. 

The  parameter  subroutines  are  especially  useful  when  information  is 
needed  concerning  the  effect  on  optimal  assignment  of  a  change  in  the 
minimum  requirements  for  entry  into  service.  Far  example,  scores  on  pre¬ 
dictor  tests  (The  Armed  Forces  Qualification  Test  and  tests  of  the  Any 
Classification  Battery)  can  be  generated  to  characterize  samples  from 
the  mobilization  population.  These  scores  can  in  turn  be  differentially 
sampled  with  respect  to  the  AFQ.T  variable,  to  depict  the  reality  that 
the  proportion  of  the  source  population  which  actually  enters  military 
service  is  omitted  from  subsequent  analysis,  but  simulation  is  repeated 
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until  a  specified  number  meet  the  AFQT  requirement.  An  example  of  one 
such  policy  is  to  simulate  a  probability  of  omitting  60  percent  of  those 
who  score  91  to  100  on  the  AFQT  variable,  45  percent  who  score  from  J1 
to  90,  and  30  percent  vho  score  from  30  to  70.  The  selection  could  be 
continued  by  computing  performance  estimates  from  the  predictor  scores 
and  further  restricting  the  sample  to  men  vho  score  higher  than  90,  say, 
for  two  or  more  job  categories.  St’\diea  of  this  kind  have  been  used  to 
recommend  policies  to  the  Army  concerning  changes  in  input  requirements 
for  enlisted  men  in  the  context  of  a  particular  deferment  policy. 

One  particular  application  involves  obtaining  estimates  of  overall 
Job  performance  as  a  function  of  various  restrictions  on  the  incoming 
population  at  a  fixed  point  in  time.  For  a  different  type  of  study, 
interest  might  be  in  overall  performance  when  various  restrictions  are 
made  on  personnel  as  they  operate  within  the  system  over  an  extended 
period  of  time.  That  is,  performance  at  different  stages  of  experience 
is  simulated.  In  the  field  situation,  samples  constructed  on  the  basis 
of  training  experience  are  usually  c  unposed  of  different  sets  of  indi¬ 
viduals  because  of  difficulty  of  doing  follow-up  studies  on  the  same  men. 
In  a  simulation  study,  however,  performance  for  the  same  individual  can 
be  followed  through  the  complete  time  cycle.  This  follow-up  is  accom¬ 
plished  by  f irst  inputting  transformation  matrices  which  yield  expected 
means,  variances,  and  covariances  for  men  vho  have  t^  months  of  experi¬ 
ence,  tg  months  of  experience,  up  to  months  of  experience.  The 

vectors  of  random  numbers  generated  for  each  individual  are  then  poet- 
multiplied  by  these  matrices,  maintaining  the  same  random  numbers  each 
time  a  given  individual  is  represented  over  time. 

At  the  start  of  the  simulation,  individuals  in  a  sample  are  optimally 
assigned  over  c  jobs  on  the  basis  of  criterion  performance.  During  the 
first  t^  months,  each  of  the  N  individuals  is  examined  for  possible  loss 

from  the  system.  This  loss  may  be  a  function  of  an  individual's  estimated 
Job  performance,  simulated  events  occurring  within  the  system,  a  random 
process  which  determines  that  near  to  p  percent  of  the  sample  will  be 
lost,  or  sane  combination  of  these  variables.  Functions  which  determine 
loss  are  added  to  the  program  as  parameter  subroutines  and  may  differ  for 
the  different  Job  categories  and  for  the  number  of  months  an  individual 
has  served. 

For  each  individual  remaining  in  the  system,  new  performance  measures 
appropriate  to  his  Job  assignment  and  the  length  of  time  he  has  spent  in 
the  system  are  simulated.  To  replace  men  lost  to  the  system,  new  random 
numbers  are  generated  and  transformed  to  expected  values  for  an  inexperi¬ 
enced  population.  Assignment  to  different  Job  categories  is  performed 
such  that  expected  performance  of  the  new  sample  is  optimal  and  Job  quotas 
reduced  by  loss  are  restored  to  their  original  values. 
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At  tbs  end  of  each  point  in  time,  t^,  the  effectiveness  of  the 

system  is  evaluated.  The  evaluation  may  be  as  simple  as  computing  the 
average  measure  of  Job  performance  for  the  different  Job  categories;  or 
it  could  involve  a  fairly  complex  function  of  the  performance  of  crew 
members  where  a  weapon  system  is  involved.  Simulation  then  proceeds 
from  time  t^  to  time  by  again  testing  observations  far  the  N 

individuals  far  loss  or  retention  in  the  system  and  by  generating  new 
observations  to  represent  enough  inexperienced  personnel  to  fill  the 
losses.  At  the  end  of  the  k-th  simulation  run,  representing  the  passage 
of  t^  months,  simulated  Observations  will  represent  individuals  with 

time  in  service  ranging  from  zero  months  to  full  length  of  the  tour. 

With  this  type  of  simulation,  quality  of  predicted  performance  in 
the  system  can  be  examined  as  the  proportion  of  experienced  personnel 
in  the  system  increases.  In  addition,  the  rate  or  change  in  rate  at 
which  men  are  lost  from  the  system  can  be  related  to  system  performance. 
Experiments  which  investigate  constant  loss  rates  over  all  Jobs  may  be 
specialized  to  examine  varying  patterns  of  loss  rates  for  different  Jobs. 
Research  of  a  more  technical  nature  might  involve  comparison  between 
different  approaches  to  optimal  allocation.  Optimal  assignment  of  the 
incoming  sample  can  be  based  only  on  performance  estimates  of  men  In 
that  sample.  A  different  approach  would  take  into  account  performance 
estimates  of  the  total  sample,  including  the  experienced  personnel,  when 
determining  initial  assignment  of  incoming  personnel. 
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APPENDIX 


FLOW  DIAGRAM  AND  MANUAL  FOR  THE  GENERAL  COMPUTER 
PROGRAM  FOR  SIMULATION  EXPERIMENTS 


A  detailed  description  of  the  general  simulation  program  with  an 
expanded  flow  diagram  (Figure  A-l)  is  presented  in  Section  I.  Section  II 
is  a  manual  for  use  of  the  program.  Included  in  the  manual  are  specifi¬ 
cations  for  input  and  requirements  for  programming  parameter  subroutines. 


SECTION  A-I 


THE  COMPUTATION  PROCEDURE 

The  program  operates  in  four  parts :  I,  input  and  initialization 
required  before  sample  generation;  II,  simulation  of  individual  response 
vectors,  optimal  allocation,  and  regeneration  of  response  vectors;  III, 
computations  and  output  based  on  the  v  individuals  in  a  sample,  plus 
initialization  required  for  generation  of  a  new  sample;  and  IV,  computa¬ 
tions  and  output  based  on  all  samples  generated.  Reference  to  the  flow 
diagram  of  Figure  A-l  may  clarify  the  sequence  of  operations. 

To  perform  operations  consistent  with  the  four  parts  of  the  main 
program,  four  entry  points  must  be  written  into  every  parameter  sub¬ 
routine.  To  transfer  control  to  parts  I,  III,  and  IV,  the  main  program- 
automatically  c^lls  all  subroutines  listed  on  the  transformation  cards 
in  order  of  increasing  size  of  integer  names  assigned  to  the  subroutines. 
(During  execution  of  part  II,  the  subroutines  are  called  in  the  order 
listed  on  the  transformation  cards.)  Dummy  instruction  ("returns")  are 
written  into  entries  for  any  of  the  four  parts  not  used  by  a  subroutine. 


INPUT  OPERATIONS 

Operations  which  constitute  Fart  I  consist  of  the  input  of  trans¬ 
formation  matrices  and  associated  mean  vectors  (box  l),  input  of  the 
vector  of  starting  numbers  to  initialize  random  number  generation  (box  2), 
input  of  the  number  of  individuals  to  be  simulated  and  other  parameters 
defining  characteristics  of  each  sample  (box  3),  Input  of  the  transforma¬ 
tion  cards  (box  6),  and  o,  the  number  of  samples  to  be  simulated  (box  7). 
To  make  it  convenient  to  generate  6  different  sets  of  samples  during  one 
computer  run,  each  set  being  defined  by  different  lists  of  transforma¬ 
tion  cards,  the  parameter  6  is  input  (box  4).  All  transformation 
matrices  required  for  the  6  sets  of  samples  are  input  simultaneously 
under  control  of  the  first  part  of  the  program  (box  1).  Any  of  these 
matrices  may  be  used  far  any  of  the  6  different  problems  by  entering  an 
integer  which  corresponds  to  the  order  in  which  the  given  matrix  was 
input  into  the  appropriate  column  of  a  transformation  card. 

The  input  of  parameters  of  data  required  for  execution  of  any  of  the 
parameter  subroutines  is  represented  by  box  8.  This  input  is  called  in 
order  of  Increasing  size  of  the  integer-named  subroutines.  Any  addi¬ 
tional  Initialization  required  for  subsequent  operation  of  the  subroutines 
is  also  performed  within  tb^a  first  entry. 


SIMUIATION  (DERATIONS 

Fart  II  of  the  program,  simulation  of  individual  response  vectors. 
Optimal  allocation,  and  regeneration  of  the  response  vectors.  Is 
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Illustrated  In  boxes  9-27.  To  begin  response  simulation  (box  9)*  the 
starting  vector  A  ,  which  controls  the  generation  of  random  numbers,  is 

»U 

set  equal  to  the  vector  -oput  to  represent  the  first  individual  of 
sample  1  (A^  in  box  2).  This  vector  automatically  changes  as  random 

numbers  are  generated  for  each  individual  (boxes  21  and  27)*  Box  16 
refers  to  the  case  where  the  responses  being  generated  far  individual  n 
have  been  found  unacceptable  by  one  of  the  parameter  subroutines;  conse¬ 
quently,  another  vector,  A  ,,  is  generated  from  which  a  new  set  of  scores 

•fell  “wH 

representing  the  n  individual  can  be  constructed. 

Optimal  allocation  over  the  v  individual  response  vectors  is  per¬ 
formed  at  the  center  of  the  simulation  operations  (box  22).  Regeneration 
of  individual  response  vectors  then  begins  at  box  10.  To  insure  that  the 
same  set  of  individual  responses  is  generated  before  and  after  allocation, 
the  starting  vector  for  individual  1  of  sample  s,  ^sl'  is  saved  for  the 

re-initialization  shown  in  box  23*  The  starting  vector  which  defines  the 
beginning  of  each  sample  is  automatically  printed  out  by  the  main  program 
(box  10)  so  that  simulation  can  be  continued  from  any  point  of  unantici¬ 
pated  termination  of  production. 

Linear  transformations  and  parameter  subroutines  specified  by  the 
f lr.t  transformation  cards  ara  Performed  on  rach  indlvUnal  response 

vector  of  random  normal  deviates  (boxes  13  and  14)  until  the  matrix  con¬ 
sisting  of  c  performance  measures  for  v  individuals  has  been  constructed. 
Execution  of  the  +  Tg  transformation  cards  is  under  control  of  the 

index  t,  as  shown  in  boxes  17-19*  21,  23-23,  27.  Bax  15  illustrates  the 
feature  of  examining  the  qualifications  of  each  individual  every  time  the 
computations  specified  on  a  transformation  card  are  completed. 


COMPUTATIONS  AND  OUTPUT 

Parts  III  (box  28)  and  IV  (box  31)  represent  the  automatic  calls  to 
the  parameter  subroutines  to  perform  operations  over  the  v  individuals  in 
a  sample  and  then  over  the  0  samples  respectively.  The  final  loop  d  de¬ 
termines  whether  a  new  set  of  transformation  cards  will  be  input  (at 
box  6)  to  define  additional  samples.  The  new  samples  will  be  based  on 
the  same  set  of  parameters  (v,  Tf,  p,  boxes  1-4)  which  defined  the  previous 
samples,  with  differences  occurring  only  as  specified  on  the  new  transfor¬ 
mation  cards.  Note  that  the  starting  vector  which  begins  the  generation 
of  random  numbers  is  reset  to  A^  (box  9),  so  that  equivalent  sets  of 

individual  responses  will  be  generated  for  each  of  the  6  sets  of  samples. 


-  20  - 


r 


21  - 


I 


Figure  A-l.  Flow  diagram  of  General  Program  for  Conducting  Optimal  Allocation  Experiments 

PART  I  -  Input  Operations 


Figure  A-l.  (continued)  PART  II  -  Simulation  Operations 


Figure  A-l.  (continued) 

PART  III  -  Computations  and  Output  (V  individuals)  and 
PART  IV  -  Computations  and  Output  (a  samples) 
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SECTION  A-II 


MANUAL  FCR  USE  CF  GENERAL  COMPUTER  PROGRAM 
FCR  SIMULATION  EXPERIMENTS 

INPUT  FORMAT 

Iter  1  i  j  (Format  1XA6,  l4,  12) 

i  is  an  integer  which  occupies  columns  8-11  and  specifies  the 
number  of  complete  sets  of  data  and  parameters  to'  be  input. 

To  debug  new  subroutines,  detailed  print-out  of  individual 
score  vectors  may  be  obtained  by  setting  J  =  1,  columns  12-13 
otherwise,  J  =  0. 

TRANSFORMATION  MATRICES 

lj,  2j,...,ij,...  (Format  10(ll,Il,Al)) 

Beginning  in  column  1,  a  two-digit  integer  ij,  which  may  be 
followed  by  a  comma,  is  listed  for  every  matrix  input,  i  =  1 
for  the  first  matrix  input  and  is  increased  by  one  for  each 
successive  matrix;  the  maximum  i  =  nmat  ("nmat"  is  a  para¬ 
meter  set  within  the  main  program  to  determine  the  total 
number  of  transformation  matrices  to  be  input).  If  a  vector 
of  means  associated  with  a  given  transformation  is  to  be 
input,  J  *  1;  otherwise,  J  =  0. 

OfP  (Format  212) 

MATRIX  X  (Format  IX,  9A8) 

Transformation  Matrix  (Format  3F8.4) 

For  every  ij  listed,  one  card  is  input  defining  the  order  of 
the  matrix,  followed  by  a  second  card  containing  any  alpha- 


numeric  name  for  the  matrix,  followed  by  the  matrix  itself, 
r  (columns  1-2)  is  the  number  of  rows,  and  £  (columns  3-4) 
is  the  number  of  columns.  Elements  of  the  matrix  are  input 
row  by  row  with  the  format  SF8.4. 

MATRIX  XM  (Fermat  IX,  9A.8) 

Means  Following  the  transformation  matrix  associated  vith  a  given 
ij,  if  J  =  1,  an  additional  alphanumeric  card  identifies  the 
vector  of  means.  The  means  begin  in  the  next  card  vith  format 
9F8.4. 

Starting  Vector 

The  7  =  24  octal  digits  which  begin  the  generation  of  y 
independent  sequences  of  random  numbers, are  input  on  3  cards 
with  format  90S  • 

v  rr  p  (Format  14,  212) 

v  (columns  1-4)  is  the  number  of  individuals  In  the  sample, 
n  (columns  5-6)  is  the  number  of  Independent  random  normal 
deviates  generated  for  each  Individual  to  initiate  the 
simulation  of  p  performance  measures, 
p  (columns  7-8)  is  the  number  of  job  categories  on  which 
optimal  allocation  is  to  be  based. 


P1  (Format  1415) 


Required  quotas  for  each  of  p  Jobs:  E  u.  =  v. 

J=1  J 

iter  2=5  (Format  1XA6,I4) 

5  specifies  the  number  of  complete  sets  of  parameter  cards 
and  data  which  arc  to  follow,  all  of  which  will  be  controlled 

by  the  set  of  cards  previously  input. 
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TRANSFORMATION  CARDS 


T1  t2  (Format  212) 

cards  will  follow  specifying  transformations  and  sub¬ 
routines  to  be  performed  on  the  vector  of  tt  normally  dis¬ 
tributed  standard  scores  generated  for  individual  n  at 
working  storage  t[,  preceding  optimal  allocation.  The  next 
t2  cards  specify  the  transformations  and  subroutines  to  be 
performed  on  the  same  individual  response  vector  regenerated 
at  tT  following  optimal  allocation. 

The  post-multiplication  of  a  response  vector  located  at 
working  storage  Tf  (or  7)  by  any  transformation  matrix  input 
(Tj),  the  addition  of  the  vector  of  means  associated  with  the 
given  transformation  (Mj),  and  the  storage  of  the  results  in 
working  storage  V  (or  tf)  can  be  specified  on  any  of  the 
T1  +  t2  transfornia'tion  cards  by  the  following  codes: 


12,1  =-> 

V 

=  ij 

T 

+  M  T 

UcPj 

i*>i 

Oj  x  Pz 

ax5. 

21,1  — > 

tr 

5cpr 

=  7 

TI 

°ixei 

+  Li. 

Different  Tj.  and  are  referenced  by  setting  I  to  any  integer 
from  1  to  nmat  corresponding  to  the  order  in  which  the  trans¬ 
formation  matrices  are  input.  If  no  vector  of  means  has  been 
input  for  Tj,  Mj  =  0.  Multiplications  are  performed  on  only 
the  first  elements  of  tf  (or  V),  and  the  result  changes  only 

the  first  elements  of  V  (or  tf) ;  or^.  and  p^  are  the  number  of 

rows  and  columns  of  T^. 
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v  ocorcg  can  be  relocated  from  one  working  storage  area 


12,0  => 
21,0  ==> 


10,1  =*> 


20,1  «=> 


10,0  *> 
20,0  =»> 


to  the  other  by  setting  1=0.  That  is, 

V  =1 

lxv  lxv 

-I 

lXy  lxv 

Following  allocation  over  Jobs  j  =  1,  2,  .  .  p,  a 
statistic,  which  is  a  function  of  the  job  J  to  which  each 
individual  is  assigned,  may  be  computed  and  stored  in  x 
(W(49)).  That  is, 

3x1  yja  U1 


X  =  V 
1x1  IXQt. 


TU  +  "*j 

OjXl 


1x1 


where  T^j  is  the  jxh  colunn  of  T^  and  is  the  element 

th 

of  Mj.  If  no  transformation  matrix  is  to  be  used,  the  J 
element  of  tl  (or  V)  can  be  relocated  in  x  by  setting  1  =  0: 

rs* 

X  =  u . 


X  =  V 


PARAMETER  SUBROUTINES 

To  perform  additional  kinds  of  computations  on  scores  in 
if,  V,  or  x,  a  list  of  subroutines  may  follow  the  transforma¬ 
tion  codes  on  any  of  the  +  Tg  transformation  cards.  Each 
subroutine  is  equated  to  some  integer  between  1  and  99  and  is 
listed  in  the  order  of  required  execution.  Beginning  in 
colunn  5  with  format  5(A1,I2),  each  subroutine  is  introduced 

by  a  comma,  with  the  following  integer  name  occupying  two 
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columns.  As  many  as  5  subroutines  may  be  referenced  on  a 
given  card.  To  illustrate,  suppose  the  post -multiplication 
of  scores  in  ft  by  the  second  matrix  input  is  required,  to  be 
followed  by  the  execution  of  subroutines  3,  98,  and  1,  which 
have  been  especially  vritten  to  operate  on  the  result  in 
V.  The  transformation  card  would  appear  as: 

12,2,03,98,01 

During  simulation  of  scores  for  a  given  individual,  a 
reject  parameter  is  evaluated  each  time  the  processing  de¬ 
fined  by  a  transformation  card  is  completed.  Depending  on 
the  value  of  this  parameter,  scores  for  the  individual  are 
either  retained  for  further  processing  or  are  treated  as  in¬ 
appropriate  for  a  given  sample  and  eliminated.  If  it  is 
desired  to  subdivide  a  list  of  subroutines  so  that  the  re¬ 
ject  parameter  will  be  evaluated  after  the  execution  of  only 
one  or  two,  say,  of  the  subroutines,  additional  era  ns  for  na¬ 
tion  cards  defining  the  subroutine  subsets  are  inserted,  but 
with  columns  1,  2,  and  4  set  to  zero.  To  illustrate,  suppose 
the  v  scores  in  V  are  to  be  transferred  to  U,  to  be  followed 
by  execution  of  subroutines  3#  98 >  and  1,  written  to  operate 
on  scores  in  ft.  The  reject  parameter,  modified  by  subroutines 
3  and  1,  say,  is  to  be  evaluated  after  the  execution  of  3  and 
1.  The  appropriate  two  transformation  cards  would  appear  as; 


21,0,03 

00,0,98,01 
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NUMBER  OF  SAMPLES 

iter  3  =  i  (Formt  1XA6,I4) 

i  is  an  integer  which  occupies  columns  8-11  and  specifies  the 
number  of  independent  samples  to  be  simulated  as  defined  by 
all  previous  parameter  cards  input. 


INPUT  CALLED  BY  SUBROUTINES 

The  input  of  parameters  and  data  my  be  required  for  the 
execution  of  subroutines  listed  on  the  transformation 
cards.  Input  called  by  different  subroutines  is  arranged 
by  increasing  order  of  the.  integers  which  name  the  sub¬ 
routines  . 

ADDITIONAL  REQUIREMENTS  FOR  PROGRAM  USE 

The  feature  of  specifying  alternative  sequences  of  linear  trans¬ 
formations  end  subroutines  as  parameters  may  be  considered 
a  compiler  for  individual  response  simulation.  Unfortunately, 
incorrect  use  of  this  part  of  the  program  will  not  produce 
simple  error  diagnostics,  but  may  generate  meaningless  results. 
To  insure  that  the  same  individuals  are  accepted  into  the 
sample  before  and  after  allocation,  the  user  must  specify  the 
correct  sequence  of  transformations  and  subroutine  calls.  In 
addition,  care  must  be  taken  to  maintain  the  correct  order  of 
simulated  scores  which  represent  tests  of  interest.  For  example, 
the  transformation  V  =  U  T,  which  is  specified  on  a  transfor¬ 
mation  card  by  equating  an  integer  to  the  order  in  which  the 
appropriate  matrix  is  input,  will  operate  only  on  the  first  a 

/v 

elements  in  the  first  working  storage  area  U  and  will  replace 
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only  the  first  fl  elements  of  the  second  working  storage  area  V; 
a  and  3  are  the  number  of  rows  and  columns,  respectively,  of 
the  transformation  matrix  T.  Scores,  then,  which  are  to  be 
modified  by  reference  to  parameter  subroutines,  but  not  by  post- 
multiplication  by  one  of  the  transformation  matrices,  must  be 
represented  oy  elements  subsequent  to  those  altered  by  linear 
transformations.  Accuracy  of  results  can  be  checked  by  setting 
the  special  debug  parameter,  which  will  produce  detailed  print¬ 
out  of  computations  intermediate  to  the  final  results. 

DEFINITION  CF  DIMENSION  STATEMENTS  AS  LISTED 
IN  THE  COMPUTER  PROGRAM 

KO(N,LC):  Matrix  of  fixed-point  performance  estimates  for  N  individuals 
on  each  of  I£  Jobs.  Currently  (January  1968),  N  =  1000  and 
LC  =  8. 

IRCW(N):  Vector  containing  the  Job  J,  )  -  1,  2,  .  .  ,  ,  LC,  to  which 

each  of  N  individuals  is  assigned. 

KQI(IC),  KQ2(LC): 

Storage  areas  for  the  required  quotas  for  each  of  LC  Jobs. 
Z(AREA):  Storage  area  for  all  transformation  matrices,  thus  requiring 

that 

NMAT 

AREA  -  L  (NA_  x  Mft  ), 

,  m  ra 

m=l 

where  the  order  of  each  matrix  input  is  NA  (rows)  x  MA 

(columns),  and  the  total  number  of  matrices  input  is  NMAT. 

Currently,  AREA  =  (23  x  23)  +  (11  x  8)  +  (ll  x  8)  -  705- 

ZM(TMA):  Storage  area  for  means  associated  with  each  transformation 

NMAT 

matrix,  with  TMA  ■  Z  MA  . 

_  1  n 


Currently,  TMA  »  23  +  8  +  8  -  39 


V(3)^  ,  V(S),  W(2S  +  1),  with  U(l)  =  W(l)  and  V(l)  =  W(S  +  l) 


Working  storage  areas  used  for  simulating  a  maximum  of  S 
individual  responses. 

Currently  (January  1968),  S  =  2k. 

IISV(S),  ISV(S),  JSV(S): 

Areas  used  for  storing  the  starting  vector  of  S  octal  digits 
called  by  subroutine  RAND. 

VF0R(9) 

Area  used  for  input  of  variable  format. 

IS(MTRAN),  JS(NTRAN,5)#  JN(NTRAN),  KN(NTRAN,6),  LIST(NSUB): 

Storage  areas  used  for  setting  up  the  sequence  of  transfor¬ 
mations  and  subroutines  used  in  simulating  responses  for 
each  individual.  NERAN  is  tbs  maximum  number  of  transforma¬ 
tion  cards  which  can  be  input  for  a  given  simulation  experi¬ 
ment.  NSUB  1s  the  maximum  number  of  different  parameter 
subroutines  which  can  be  listed  on  transformation  cards  for 
the  experiment. 

Currently,  MERAN  -  8  and  NSUB  ■  10. 

NA(NMAT),  MA(NMAT),  NT(NMAT): 

Areas  used  for  addressing  transformation  matrices  and 
associated  vectors  of  means.  Currently,  NMAT  -  3. 

For  the  most  efficient  utilization  of  computer  space, 
the  main  program  can  be  recompiled  so  that  N,  LC,  AREA,  TMA, 
and  WAT  are  consistent  with  requirements  for  specific 

^The  storage  area  represented  here  by  S  is  represented  in  the 
description  of  the  program  by  y. 
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projects.  The  statement  "MAT  ■  3%  which  is  within  the 
first  part  of  the  main  program,  will  also  have  to  he  changed. 
Changes  In  S,  NTRAN,  and  NSUB  will  not  result  in  appreciable 
saving  of  space.  If  changes  are  required  for  S,  NTRAN,  and 
N3UB,  additional  changes  must  be  made  in  statements  of  the 
main  program. 

PROGRAMMING  REQUIREMENTS  FCR  PARAMETER  SUBROUTINES 

Any  subroutine  written  to  handle  computations  specific  to  different 
projects  must  be  associated  with  an  integer  name,  and  the  first  parameter 
of  every  subroutine  must  be  "JSUB".  Thus,  "SUBROUTINE  SUB  J  (JSUB,  ...)", 
when  J  is  any  Integer,  would  appropriately  begin  a  subroutine.  In  addi¬ 
tion,  the  first  statement  of  any  subroutine  must  be  "GO  TO  (a,  b,  c,  d), 
JSUB",  a,  b,  c,  and  d  not  all  necessarily  different. 

All  subroutines  listed  on  the  transformation  cards  are  automatically 
called  in  four  different  parts  of  the  main  program.  Corresponding  to 
each  part,  JSUB  is  set  to  1,  2,  3,  or  4  to  permit  execution  of  different 
types  of  subroutine  operations. 

Before  beginning  response  slwdatlon  for  any  sample  of  v  individuals, 
the  main  program  sets  JSUB  -  1  and  transfers  control  to  statement  a  of 
each  subroutine  in  order  of  Increasing  size  of  the  Integers  naming  the 
subroutines.  Any  initialization  or  calls  for  Input  of  data  or  parameters 
required  for  subsequent  operations  must  be  written  into  this  "part  a"  of 
each  subroutine.  If  no  such  initialization  is  required,  statement  a  will 
be  a  "RETURN". 


During  the  simulation  of  individual  score  vectors  in  the  second  part 
of  the  main  program,  JSUB  -  2j  for  each  individual  in  every  sample,  con¬ 
trol  passes  to  statement  b  of  each  subroutine  according  to  the  order 
transformations  and  subroutines  are  listed  on  the  transformation  cards. 
The  main  function  of  subroutine  sections  beginning  at  statement  b,  then, 
will  be  to  operate  on  scores  in  working  storage  areas  U,  V,  or  x  or  to 
construct  KO,  the  v  x  p  matrix  of  scares  used  by  subroutine  OUT  for 
optimal  allocation. 

After  all  computing  to  be  performed  on  v  individuals  has  been  com¬ 
pleted,  the  main  program  seta  JSUB  =>  3#  and  control  is  transferred  to 
statement  c  of  each  subroutine,  again  in  order  of  increasing  size  of  the 
integers  naming  the  subroutine.  "Bart  c"  of  each  subroutine  must  be 
written  to  perform  any  aussaary  computations  based  on  all  v  individuals 
for  the  sample  Just  completed,  and  to  perform  any  Initialization  required 
for  generating  the  next  sample.  If  no  such  computations  are  required, 
statement  c  must  be  a  "RETURN". 

When  simulation  of  the  total  of  o  samples  has  been  completed,  the 
main  program  seta  JSUB  -  4,  and  control  is  transferred  to  statement  d  of 
each  subroutine,  again  according  to  the  order  of  the  subroutine  nuntoers. 
Any  aussaary  computations  or  output  based  on  the  completed  set  of  a 
samples  or  any  initialization  required  before  parameters  defining  a  new 
set  of  a  samples  are  input  must  be  written  beginning  at  statement  d. 
Otherwise,  statement  d  must  be  a  "RETURN". 
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MODIFICATION  OF  SUBROUTINE  EXSUB 


Tbs  call  statement  for  any  of  the  parameter  subroutines  listed  on 
the  transformation  cards  occurs  in  the  executive  subroutine.  Each  time, 
then,  that  a  new  subroutine  Is  prepared  for  a  specific  project,  "Sub¬ 
routine  EXSUB"  must  be  recompiled. 

At  the  time  far  execution  of  any  of  the  subroutines  listed  on  the 
transformation  cards,  the  main  program  automatically  sets  a  parameter 
"KM"  within  "EXSUB"  to  the  integer  name  of  the  subroutine.  Any  test 
which  recognizes  that  KM  equals  this  Integer  name,  J,  say,  and  is 
followed  by  the  execution  of  a  statement  calling  "SUBROUTINE  J",  may  be 
written  into  the  executive  routine.  One  convenient  method  would  be  to 
extend  the  length  of  the  computed  go -to  statement  (currently,  "GO  TO 
(1,2,3,4,5),  KM"),  making  the  parenthesized  integer  equal  to  J  such 
that,  when  KM  *  J,  control  will  be  transferred  to  statement  J,  and  sub¬ 
routine  J  will  be  executed.  Care  must  be  taken  to  insert  any  new  sub¬ 
routine  call  statements  to  operate  within  the  range  of  the  do-loop  which 
terminates  at  statement  (currently  labeled)  25. 

All  regions  likely  to  be  referenced  by  specific  subroutines  are  in 
the  C0M4QN  area  for  both  the  main  program  and  EXSUB.  Those  regions  most 
likely  to  be  needed  as  parameters  in  any  of  the  subroutines  are  defined 
as  follows: 

KO  the  v  x  p  matrix  of  fixed-point  scores  used  by  subroutine 

CfTT  for  optimal  allocation. 

U  and  V  working  storage  areas  beginning  at  W(l)  and  W(25), 

respectively,  used  for  the  post -multiplication  of  an 


individual  score  vector  by  a  transformation  matrix  and 
possible  subsequent  addition  of  a  mean  vector. 

LC  (equivalent  to  p) 

a  single  score  selected  from  the  p  scores  simulated  for  a 
given  individual  to  correspond  to  J,  J  =  1,  2,  .  .  .  ,  p, 
the  Job  to  which  the  individual  is  assigned. 

N  the  number  of  individuals  in  a  given  sample. 

I  index  for  the  number  of  individuals:  I  *  1,  2,  .  •  .  ,  N 

ITER;}  (equivalent  to  S) 

the  number  of  samples  of  "N"  individuals  to  be  simulated 
for  each  set  of  transformation  cards  input. 

1X3  index  for  the  number  of  samples:  IT3  •  1,  2,  .  •  •  ,  HER} 

JECT  parameter  set  by  any  subroutine  and  sensed  by  the  main 

program  to  determine  whether  a  given  individual  is  qualified 
for  the  sample  being  simulated.  If  JECT  «  1,  the  Individual 
is  accepted;  if  JECT  »  2,  the  individual  is  rejected.  The 
main  program  Initializes  JECT  to  1. 

DESCRIPTION  CP  EXISTING  SUBROUTINES 
The  subroutines  which  are  listed  below  have  been  written  for 
generalized  application.  Subroutines  limited  to  use  on  specific  projects 
are  not  described. 

SUBROUTINE  SUB  1  (JSUB,  KO,  W,  I,  LC) 

SUB  1  rounds  the  LC  floating  point  scores  simulated  for  individual  I 

and  located  at  IJ  to  the  nearest  integers.  These  scores  are  then  stored  in 

til  ^ 

the  I  row  of  the  fixed  point  matrix  area  KO  used  for  optimal  allocation 
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by  SUBROUTINE  OIT 


SUBROUTINE  SUB  2  (JSUB,  KO,  W,  I,  LC) 

SUB  2  rounds  the  LC  floating  point  scores  simulated  for  individual  I 

a# 

and  located  at  V  to  the  nearest  integers .  These  scores  are  then  stored  in 
the  row  of  the  fixed  point  matrix  area  KO  used  for  optimal  allocation 
by  SUBROUTINE  OTT. 

SUBROUTINE  SUB  3  (JSUB,  W,  N,  ET3,  HER 3) 

SUB  3  computes  (1)  the  sum  and  (2)  the  mean  value  in  x  ■  W(49)  over 
N  individuals  and  (3)  a  summary  mean  of  the  value  in  x  over  HER3  samples 
of  N  Individuals.  This  subroutine  was  written  to  compute  the  allocation 
sum  and  average  for  each  sample  of  N  individuals  and  the  allocation 
average  for  all  samples  combined,  x  is  set  to  the  performance  estimate 
on  the  Job  to  which  each  individual  has  been  assigned. 

SUBROUTINE  SUB  4  (JSUB,  W,  I,  N,  ET3,  LC,  3R0W) 

SUB  4  computes  the  frequency  distributions  of  scores  located  in 
x  ■  W(49)  for  each  of  the  Job  categories  to  which  men  are  assigned. 

Means  and  standard  deviations  for  scares  in  each  Job  category  are  com¬ 
puted  far  each  sample  of  N  individuals.  Frequency  distributions,  means, 
and  standard  deviations  are  also  computed  by  Job  category  for  all 
samples  coofclmed. 

Four  cards  are  required  input. 

Card  1:  identification  card  for  labeling  frequency  distributions, 
with  format  (9A8). 

Card  2:  parameters  which  determine  the  scale  of  the  distributions, 
with  format  (2F8.4,  14) 

Z  ■  length  of  each  interval 
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SZ  =  lower  bound  of  first  interval 


NZ  =  number  of  Intervals 

Card  3:  variable  format  for  printing  LC  floating  point  numbers  (means, 
standard  deviations,  and  interval  midpoints);  e.g.,  (15F3.4). 
Car'd  4:  variable  format  for  printing  LC  fixed  point  numbers 
(frequencies);  e.g.,  (1518). 

SUBROUTINE  SUB  3  (JSUB,  U,  I,  N,  IQ) 

Compute  means,  standard  deviations,  and  correlation  matrix  for  IQ 
variables  in  U  over  N  Individuals. 

SUBROUTINE  SUB  6  (JSUB,  V,  I,  N,  LC) 

Compute  means,  standard  deviations,  and  correlation  matrix  for  LC 
variables  in  V  over  N  individuals. 
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